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DESCRIPTION 

♦ 

Interactive computer-aided diagnosis 

The present invention relates to the field of computer-aided diagnosis (CADx). In 
particular, the present invention relates to a method of computer-aided diagnosis, to a 
5 data processing device and to a corresponding computer program for a data processing 
device. 

Despite intense research activities in the field of computer-aided diagnosis, the transfer 
of resulting algorithms to the target market, i.e. clinical applications, is often not 
10 successful. Methods of computer vision, automated classification, or comparable 
algorithmic solutions are not regularly used and even less regularly trusted by 
physicians. 

The most important reasons for such distrust toward research results include: 
15 - field testing in limited environments, 

- data processing methods remain incomprehensible to non-technical users, and 

* 

- dependency of the quality of an algorithm from technical parameter settings; 

Despite growing awareness of insufficient validations, inappropriate approaches such 
20 as, for example, described by Globus A. et. al. "14 ways to say nothing with scientific 
visualization" IEEE Computer 27 (7) pp. 86-88, 1994 are used. The computer vision 
algorithms are mostly validated by subjective visual impression of the researchers 
themselves. A quantitative confidence standard for all applications of CADx and similar 
applications is required to increase a well-founded trust of physicians towards these 
25 applications. 

It is an object of the present invention to provide for an improved computer-aided 
diagnosis. 
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According to an exemplary embodiment of the present invention as set forth in claim 1, 
the above object may be solved by a method of computer-aided diagnosis wherein 
acquired first diagnostic data is processed on the basis of a first parameter set to 
determine a first diagnosis result Then, a confidence interval is determined with respect 
5 to the diagnosis result The first diagnosis result and the confidence interval is 

displayed, for example, to a user. The first parameter set is then adjusted on the basis of 
an input, for example, from a user of the system. Then, the diagnostic data is 
reprocessed on the basis of the adjusted first parameter set to determine a second 
diagnosis result which is displayed. 

According to this exemplary embodiment of the present invention, a multi-step- 
methodology is suggested which is applicable to a plurality of image- and signal 
processing algorithms that are often the base of clinical data processing applications. 
According to an aspect of this exemplary embodiment of the present invention, a 
15 confidence interval with respect to the first diagnosis result is provided. In other words, 

- 

a feedback is provided to the user of the method which gives the user a feeling with 
respect to the dependability of the diagnosis. For example, for quantitative 
measurements, a 95% interval ("in 19 of 20 cases, the true result will be in the 
following range") maybe part of the confined presentation. Geometric results, such as 
20 segmentations or registrations of, for example, organs of a patient may instead of a 
statistic visualization of the confidence interval be displayed with an explorable "grey 
aiea" representing the area where the segmented or registered form may be varying. 

By an appropriate input, the user may alter the first parameter set. Then, a reprocessing 
25 of the diagnostic data may be performed on the basis of the adjusted first parameter set 
to determine the second diagnosis result From this, the user of the system comes to 
know the influence of the changed parameter on the diagnosis result, and therefore the 
_stabihty_and.reliabi.lity _of_ the .^mput^^sult 
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Advantageously, due to the confidence feedback, a trust in the system or method may be 
improved. Furthermore, due to the variation of the parameters, the user may 
interactively explore the influence of certain parameters or certain parameter ranges on 
the diagnosis result to thereby establish a feeling with respect to the dependability of the 
5 diagnosis result. 

According to another exemplary embodiment of the present invention as set forth in 
claim 2, at least one parameter of the first parameter set may be varied by a user by a 
corresponding input. This may allow for an interactive reprocessing of the diagnostic 
10 data. 

« 

According to another exemplary embodiment of the present invention as set forth in 
claim 3, a distrust selection option is provided, for example, to the user of the system 
upon selection of which the first diagnostic data and the corresponding first parameter 

1 5 set is forwarded to a service port such that, for example, an R&D team may use this 
information for further adjusting the method. For example, the selection of the distrust 
selection option may result in a storage of the data of the actual case in an anonymised 
data base. A customer advantageously may collect this data and pass it on to marketing 
and R&D. This may allow that a user feels more empowered to increase the quality of 

20 the method. Preferably, the range of parameters is extracted from clinical data acquired 
at the site of application, which enables each embodiment of the invention to 
individually adapt to clinical setups. 

According to another exemplary embodiment of the present invention as set forth in 
25 claim 4, a trust selection option is provided upon selection of which the first parameter 
set may be stored together with the first diagnostic data. This set of first parameter set 
and first diagnostic data which has been proved to be appropriate may be used as 
ground truth for other diagnosis or may, for example, also be used for further training of 
the method or system. 

30 
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According to. another exemplary embodiment of the present invention as set forth in 
claim 5, the first diagnostic data maybe compared to second diagnostic data. A 
similarity of the first and second diagnostic data may be determined and when the 
similarity meets with that criteria, the first diagnostic data may be reprocessed on the 
5 basis of a second parameter set originally belonging to the second diagnostic data. 

According to another exemplary embodiment of the present invention as set forth in 
claim 6, the methods allow for an explorative determination of a dependability of at 
least one of three first and second diagnosis results. 

10 

According to another exemplary embodiment of the present invention as set forth in 
claim 7, a data processing device is provided allowing for a visualization of a 
confidence interval relating to a diagnosis performed on the basis of a parameter sets. 
Furthermore, this data processing device may allow for a reprocessing of the diagnostic 
1 5 data on the basis of an adjusted parameter set. This reprocessing may have the following 
effects. 

As a first effect, by adjusting the first parameter set, a second diagnosis result may be 
achieved which is more accurate. As a second effect, by adjusting the parameters of the 
20 first parameter set, a user may explore the dependability of the diagnosis result from the 
parameters. By this, the confidence interval may be visualized. 

The present invention relates also to a computer program for a data processing device 
for performing a computer-aided diagnosis. The computer program according to the 
25 present invention is set forth in claim 8. The computer program according to the present 
invention is preferably loaded into a working memory of a data processor. The data 
processor is thus equipped to carry out the method of the present invention. The 

computer program jnay_be.stored on_a„computer readable medium, such as_a_CI>RQM._ 

The-computer program^^ " 

30 WorldWideWeb and can be downloaded into the working memory of a data processor 
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from such a network. The computer program may be written in any suitable 
programming language, such as C++. 

It may be seen as the gist of an exemplary embodiment of the present invention that a 
5 confidence interval relating to the dependability of the diagnosis result on certain 
parameters is visualized. On the basis of an input, the diagnostic data may be 
reprocessed on the basis of an adjusted parameter set to determine a second diagnosis 
result which is displayed on the display. Furthermore, standardized feedback 
mechanisms, such as trust or distrust selection options may be provided allowing users 
10 to express their individual trust with respect to the method and/or system and to 

furthermore improve presented results by allowing that this feedback may automatically 
be used for further improving the method or system. 

These and other aspects of the present invention are apparent from and will be 
1 5 elucidated with reference to the embodiment described hereinafter and with respect to 

» 

the following drawings: 

r 

Fig. 1 shows a schematic representation of a data processing device according to an 
exemplary embodiment of the present invention which is adapted to execute a method 
20 according to an exemplary embodiment of the present invention. 

Figs. 2a and b show a flowchart of an exemplary embodiment of a method of operating 
the data processing device of Fig. 1 according to an exemplary embodiment of the 
present invention. 

25 

Fig. 3 shows an exemplary embodiment of a display presented to a user according to the 
present invention. 

Fig. 1 depicts an exemplary embodiment of a data processing device according to the 
30 present invention for executing an exemplary embodiment of a method in accordance 
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with the present invention. The data processing device depicted in Fig. 1 comprises a 
central processing unit (CPU) or data processor 1 connected to a memory 2 for storing 
the diagnostic data, the parameter sets or any intermediate results. The data processor 1 
may be connected to a plurality of input/output-, network- or diagnosis devices, such as 
5 MRI devices or CT devices via one or more data transfer mechanisms. The image 
processor is furthermore connected to a display device 4 (e.g. a computer monitor) for 
displaying information or images computed or adapted by the data processor 1 . An 
operator or user may interact with the data processor 1 via a keyboard 5 and/or other 
output devices which are not depicted in Fig. 1. 

10 

Figs. 2a and b show a flow-chart of an exemplary embodiment of a method for 
performing a computer-aided diagnosis in accordance with the present invention. 

The following exemplary embodiment relates to the field of computer-aided viewing. 
1 5 However, it should be noted that the present invention may be applied to a variety of 
application fields, such as, for example, computer assisted navigation in surgery, 
intervention planning, outcome control or others. 

After the start in step S 10 the method continues to step SI 1 where diagnostic image 
20 data is acquired. The diagnostic image data may, for example, be an image from a 
microscope. Then, the method continues to step S12 where a determination is made 
with respect to whether there is a ground truth for this diagnostic image data or not In 
case it is determined in S12 that there is ground truth for this diagnostic image data, the 
method continues to step S 1 6 where a first parameter set is set corresponding to third 
25 parameters of the ground truth. Then, the method continues to step S17. 

The adjusted parameters of the parameter sets may comprise a significance level for 

statisticaLtests, threshold 

differentprocessmg^epsr^ 

30 embodiment, additionally properties of the input image data like intensity, contrast, and 
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noise intensity can be changed so that the stability of computed results to these image 
properties can be displayed to the user as well. 



In case it is determined in step S12 that there is no ground truth, the method continues 
5 to step S 1 3 where it is determined whether there is comparable data stored in a memory 
or not In case it is determined that there is comparable data in an accessible memory, 
the method continues to step S14 where the first parameter set is set in accordance to 
second parameters that were valid for the comparable data. Then, the method continues 
to step S17. 

10 

In case it is determined in step S13 that there is no comparable data, the method 
continues to step SI 5 where the first parameter set is set in accordance with a preset 
. parameter range. Then, the method continues to step SI 7. 

15 In step S17 a computer-aided diagnosis is performed on the basis of the first parameter 
range. Then, the method continues to step SI 8 where the diagnosis result is displayed to 
a user of the system, for example on display 4. Then, the method continues to step SI 9 
where a dependability or trustworthiness of the displayed diagnosis result may be 
explored by a user by adjusting variables of the first parameter set The adjusted 

20 variables are used to reprocess or re-perform a diagnosis to determine new diagnosis 
result The new or adjusted diagnosis result is then displayed to the user, for example 
via display 4. 

The user may, for example, adjust variables by moving a slider by means of a pointing 
25 device, such as a mouse pointer on a display. Also, for example, a track ball, mouse or 
mouse wheel may be used to adjust the variables. 

Advantageously, by adjusting the parameters, the user may explore the dependability or 
trust worthiness of the diagnosis result In particular, the dependability of the diagnosis 
30 result may be explored with respect to the adjusted variables. In other words, by 
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exploring the dependability or trust worthiness, a quantitative confidence measurement 
may be conveyed to the user of the system. 

In a variant of this exemplary embodiment of the present invention, is also possible to 
5 provide quantitative confidence. For example, the methods may include visual feedback 
on the result probability distribution due to algorithmic uncertainties. For example, for 
quantitative measurements, a 95% interval ("in 19 of 20 cases, the true result will be in 
the following range") may be part of the confined presentation to the user on display 4. 
Geometric uncertainties with respect to geometric results obtained, for example, by a 
1 0 segmentation or registration may advantageously be not statistically visualized by using 
numbers but with an explorable "grey area", such as, for example, depicted in Fig. 3. 

During the development and the initial configuration of the method, not only a set of 
technical parameters is determined which delivers in the middle the best result but for 

15 all available training data an individual parameter set is determined which reproduces a 
known gold truth in a most appropriate manner. From this, for each parameter, a 
variance range may be provided or displayed to the user. Then, as described above, the 
user may use an input means, such as a mouse, mouse wheel or a windows slider 
displayed on the display to adjust a parameter within this variance range. 

20 Advantageously, according to this aspect of the present invention, the user may directly 
(interactively) follow the changes to the diagnosis result on the display. 

Then, as indicated by the encircled A at the bottom of Fig. 2a and at the top of Fig. 2b, 
the method continues to step S20 where it is determined whether there is a distrust entry 
25 or not A user may input a distrust input indicating that in spite of all adjustments made 
in step SI 9, no trust has been built up to the diagnosis result i.e. the user does not 
believe that the diagnosis result is appropriate. In case it is determined in step S20 that 
there is a distrust entry, as indicated by the encircled B at the top of Fig. 2b and at the 
botfom^Fig;2v^ 

~~ adjusted. This may be done by, for example, selecting a different processing method for 
steps S 1 7 to S 1 9 or by loading another set of first parameters. 
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According to a variant of this exemplary embodiment of the present invention it may 
advantageously be possible to automatically forward the diagnostic image data and the 
corresponding first parameter set which was distrusted by the user to a service port from 
5 which it may be downloaded to a R&D department This data may then be used to 
further improve the first parameter set to achieve better results. 

In case it is determined in step S20 that there is no distrust entry, the method continues 
to step S22 where it is determined whether there is a trust entry or not In case it is 

1 0 determined in step S20 that the trust selection option was selected i.e. there was a trust 
entry, the method continues to step S23 where the diagnostic image data and the first 
parameter set is added to the comparable data and/or the ground truth and/or is used for 
adjusting the preset range in step S21 . As may be taken from Fig. 2b and as indicated by 
the encircled C at the top of Fig. 2b and at the bottom of Fig. 2a, the method continues 

15 from step S23 to step S21 or to step S13 or to step S12. Id a variant, the method may 
stop at the encircled C, i.e. after step S23. 

In case it is determined in step S22 that there was no trust entry, the method continues 
to step S24 where it is determined whether a learning selection option has been selected 

20 i.e. whether there is a learning entry or not In case it is determined in step S24 that 
there is a learning entry, the method continues to step S25 where training examples are 
used to adjust the first parameter set. These training examples may be the diagnostic 
image data and the corresponding first parameter set added to the memory in step S23 
of a previous application run where the result was trusted by the user. Training is 

25 possible whenever there are means to determine the true result other than by the data 
processing method, e.g. by an expert opinion or other diagnostic data acquisitions. As 
indicated by the encircled D at the top of Fig. 2b and at the bottom of Fig. 2a, the 
method continues from step S25 to SI 5. la a variant, the method may also stop after 
step S25. 
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In case it is determined in step S24 that there is not learning entry, the method continues 

■ 

to step S26 where it ends. 

Advantageously, as may be taken from the above description, the user may improve the 
5 CADx system by him- or herself when there is a corresponding set of ground truth and 
image data. For example, this set of ground truth and image data may be acquired from 
an alternative parallel diagnosis. Thus, for example, the user may acquire a ground truth 
with respect to certain diagnostic image data from an intervention or from another 
imaging method. Also, an expert opinion may provide for the required ground truth. 
1 0 Then, on the basis of the ground truth, the system may automatically determine a set of 
parameters which allows for an improved reproduction i.e. for improved diagnosis 
result. The diagnostic image data and the corresponding ground truth and the thereto 
belonging parameter set is stored. 

1 5 Furthermore, as may be taken from above, the system may also be trained which may 
allow for an automatic selection of appropriate parameters. The system may 
continuously trained on the basis of training data which is constantly renewed or 
extended. Thus, by constantly Iraining the system on the basis of a constantly growing 
set of training data, the system may allow for improved diagnosis result. 

20 

For example, the diagnosis may also be performed on the basis of comparable data if, 
for example, there is no ground truth available. A comparable data set may be 
determined by, for example, deteimining a similarity between the current diagnostic 
image data and image data stored in the memory. Such image similarity may be 

25 determined on the basis of global image features. Also, such image similarity may be 
determined on the basis of statistical properties of image intensities. Also, the method or 
system maybe adapted such that a plurality of comparable images is taken and the most 

appropriate-parameter setand respective variations-are jkimmBsAsmJ!^.^msifj& 

interpolationijetween-lh^ 

30 images. For the further processing of the diagnostic image data, the parameter set 
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corresponding to the comparable image which has been found may be used 
subsequently. 

Advantageously, in addition to the visualization of confidence intervals, according to 
5 the above exemplary embodiment of the present invention, a standardized feedback 
mechanism is provided which offers similar appearance and user interaction for 
different embodiments of the invention. Furthermore, advantageously, the confidence 
intervals are made explorable by user interaction. For example, uncertainty in 
quantification, registration and segmentation algorithms may be mediated by means of 
1 0 simple sliders. Moving the slider from left to right may result in the presentation of 
algorithmic results that cover the fall confidence range. 

■ 

Fig. 3 shows an exemplary embodiment of a display that may be displayed on display 4 
according to the present invention. 

15 

As may be taken from Fig. 3, the display may, for example, be performed in Windows 
format having a region 30 where the diagnostic image data is displayed. Furthermore, 

s 

there are provided three button 32, 34 and 36. Button 32 allows for an automatic trust 
feedback. According to a variant of this exemplary embodiment of the present 
20 invention, by activating the trust button 32, the image data currently displayed on area 
30 and the corresponding data that may automatically be forwarded to a service port 
from which it may be distributed for further use. This forwarding may, for example, be 
performed automatically by email. 

25 The distrust button 34 serves to express the distrust of the user in the segmentation 

result achieved by means of the current parameter set Advantageously, by activating the 
distrust button 34, the diagnostic image data displayed on area 30 and the corresponding 
parameter set may be forwarded to the service port for further use. 
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Reference numeral 38 indicates the segmentation result. line 40 indicates the diagnosis 
result determined on the basis of the current parameter setting. Dotted lines 42 visualize 
the confidence intervals. Line 40 represents the diagnostic result when the slider 44 is 
centered. The user may then explore the confidence interval of the applied algorithm. 
5 The segmentation boarder evolves according to the slider position in the confidence 
range indicated by dotted lines 42. The quantification results change as well from a 95% 
secured minimal value to a maximal value. Button 36 "train known standard" may 
allow the user to manually correct the contour. According to a manual correction of the 
contour, the system may then adjust parameters of the segmentation accordingly. 

10 

The 'train known standard" button 36 may be used to adjust technical parameters that 
influence the algorithms performance. Whenever a second opinion, for example an 
expert's subjective visual impression or a ground truth measurement is available, these 
results can be trained into the algorithm. Using the "learning from examples" paradigm 

15 as, for example, described in Bredno J. et al.: "Automatic Parameter Setting For 

Balloon Models" Procs. SPIE 3979, pp 1 185-1 195, 2000 which is hereby incorporated 
by reference, technical parameters are adjusted so that the ground truth is reproduced by 
the algorithm. According to a variant of this exemplary embodiment, this learning from 
examples may further include a regression analysis that is able to adjust technical 

20 parameters based on global input's data characteristics, such as described in Lehmann 
T.M. et. al.: 'Texture-Adaptive Active Contour Models" LNCS 2013, pp 387-396, 2001 
which is hereby incorporated by reference. 

Advantageously, according to the present invention, a multi-step method is provided 
25 which is applicable to a variety of image- and signal processing methods that are the 
base of clinical applications and which are applied to computer-aided diagnosis. Results 
of such algorithms include quantitative measurements, transformation parameters for 

.registration, geometric segmentation result 

jnventionrthelrus^ 

30 improved. 
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It should be noted that the present application is not limited to the field of computer- 
aided diagnosis but may also be applied to similar fields like intervention planning, 
navigation support and outcome control where quantitative information is extracted 
from medical data acquisitions. 



PHDE040065 EPP 

-14- 



CLAIMS 



1. A method of computer-aided diagnosis, the method comprising the steps of: 

acquiring first diagnostic data; 

processing the first diagnostic data on the basis of a first parameter set to 
determine a first diagnosis result; 

determining a confidence interval with respect to the diagnosis result; 

displaying the first diagnosis result and the confidence interval; 

adjusting the first parameter set on the basis of an input; 

reprocessing the diagnostic data on the basis of the adjusted first parameter set to 
determine a second diagnosis result; and 

displaying the second diagnosis result. 

2. The method of claim 1, 

wherein, the first parameter set comprises a plurality of parameters; 
varying at least one parameter of the first parameter set; 
adjusting the first parameter set on the basis of the at least one parameter which 
is varied; and 

interactively reprocessing the diagnostic data on the basis of the adjusted 
parameter set to determine the second diagnosis result and displaying the second 
diagnosis result 

3. The method of claim 1, further comprising the steps of: 

providing a distrust selection option; and 

forwarding the first diagnostic data and the corresponding first parameter set to a 
service port when the distrust selection option is selected. 
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4. The method of claim 1, further comprising the steps of: 

providing a trust selection option; and 

storing the first parameter set in correspondence with the first diagnostic data 
5 when the trust selection option is selected. 

5. The method of claim 1, further comprising the steps of: 

comparing the first diagnostic data to second diagnostic data; 

deciding whether the first diagnostic data is comparable to any of the second 

10 diagnostic data; 

reprocessing the first diagnostic data on the basis of a second parameter set 
belonging to similar second diagnostic data to determine a third diagnosis result; and 
displaying the third diagnosis result 

15 6. The method of claim 1, 

wherein the method allows for an explorative determination of a dependability 

of at least one of the first and second diagnosis results. 

7. Data processing device, comprising: 
20 a memory for storing first diagnostic data and a first parameter set; 

a processor for processing the first diagnostic data for a computer-aided 
diagnosis to determine a first and a second diagnosis result; and 

a display for displaying the first and second diagnosis results; 
wherein the first diagnostic data is processed by the processor on the basis of a 
25 first parameter set to determine a first diagnosis result; 

wherein a confidence interval is determined by the processor with respect to the 

diagnosis result; 

wherein the first diagnosis result and the confidence interval are displayed on the 



.displays 
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wherein the first parameter set is adjusted on the basis of an input by the 
processor; 

wherein a reprocessing the diagnostic data on the basis of the adjusted first 
parameter set to determine a second diagnosis result is performed by the processor; and 
wherein the second diagnosis result is displayed on the display. 

8. Computer program for a data processing device for performing a computer-aided 
diagnosis, wherein, when the computer program is executed on a data processor of the 
data processing device, the data processing device executes the following steps: 
acquiring first diagnostic data; 

processing the first diagnostic data on the basis of a first parameter set to 
determine a first diagnosis result; 

determining a confidence interval with respect to the diagnosis result; 
displaying the first diagnosis result and the confidence interval; 
adjusting the first parameter set on the basis of an input; 

reprocessing the diagnostic data on the basis of the adjusted first parameter set to 
determine a second diagnosis result; and 
displaying the second diagnosis result. 
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ABSTRACT 

Interactive computer-aided diagnosis 

* 

Despite intense research activities in the field of computer-aided diagnosis methods of 
computer vision, automated classification or comparable algorithmic solutions are not 
5 regularly used and even less regularly trusted by physicians. According to an exemplary 
embodiment of the present invention, a confidence interval of the performed diagnosis 
is visualized and a standardized feedback mechanism is provided which allows for an 
interactive improvement of the method. 

10 Fig. 3 
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FIG 3 



